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PATENT APPLICATION 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
In re application of 
Stefan HAHN and Walter ZIE6LER 
Appln . No • : 

Filed: February 27, 2002 

For: METHOD FOR DISPLAYING A PERSPECTIVE IMAGE AND DISPLAY 
DEVICE FOR AT LEAST ONE PASSENGER OF A MOTOR VEHICLE 

Attorney Docket No.: 3926.037 

PRELIMINARY AMENDMENT 

Box : PCT 

Honorable Commissioner of 

Patents and Trademarks 
Washington, D.C. 20231 

Sir: 

Prior to examination of the above -identified application, 
please amend the application as follows: 

IN THE CLAIMS (CLEAN VERSION) : 

Please cancel original Claims 1-26; please add the following 
new Claims 27-49: 

27. A process for displaying a perspective image (B) with an 
image element (4A through 4H) for at least one occupant of a 
vehicle, wherein the image (B) represents the perspective of 
the occupant, said process comprising: 

generating a virtual display representing the operating 
environment of the vehicle, 

displaying within the virtual display the image element 
{4A through 4H) as a three dimensional image. 
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changing at least one characteristic of an image 
element (4A through 4H) depending at least one of: 
the roadway ahead (F) , 

an operating parameter of the vehicle, and 

a parameter of an object (6) identified in the area of 

the vehicle preceding roadway (F) , 

wherein said display includes at least one three 

dimensional image element representing an operating 

parameter or providing warning information. 

28. A process according to Claim 27, wherein the change in the 
image element {4A through 4H) is a change in shape, color, 
position and/or dimension. 

29. A process according to Claim 27, wherein the roadway (F) is 
displayed as an image element (4A) . 

30. A process according to Claim 27, wherein the contour of the 
roadway (F) in the display (B) is continuously conformed to 
the natural course of the stretch of road ahead of the 
vehicle. 

31. A process according to Claim 27, wherein a speedometer or 
tachometer scale (T) is provided as an image element (4B) • 

32. A process according to Claim 31, wherein the speedometer or 
tachometer scale (T) is continuously conformed to the 
contour of the roadway (F) . 

33. A process according to Claim 27, wherein the speed of the 
vehicle is detected as an operating parameter. 
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34. A process according to Claim 27, wherein the operating 
parameter of the vehicle is provided as an image element 
(4D) . 

35. A process according to Claim 27, wherein the speed, type 
and/or dimension of the object (6) is determined and 
evaluated as a parameter. 

36. A process according to Claim 27, wherein the object (6) in 
the area of the roadway (P) is classified and evaluated as 
to a type selected from the group consisting of vehicle, 
obstacle, pedestrian and/or traffic sign. 

37. A process according to Claim 27, wherein a symbol 
representing the object (6) is provided as an image element 
(4E, 4G through 4H) . 

38. A process according to Claim 27, wherein the actual detected 
value of the operating parameter of the vehicle and/or the 
parameter of the object (6) is provided as an image element 
(4D) . 

39. A process according to Claim 27, wherein an acoustic and/ or 
an optical signal is emitted upon exceeding and/or falling 
below a threshold value for a characteristic of the roadway 
(F) , the operating parameter of the vehicle, or a parameter 
of the object (6) or the image elements (4A through 4H) . 

40. A process according to Claim 39, wherein the threshold value 
is preset. 
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41. A process according to Claim 39, wherein the displayed 
speedometer or tachometer scale (T) is changed in at least 
one characteristic upon exceeding and/or falling below the 
threshold value of the vehicle (P) , the operating parameters 
of the vehicle and/or the parameters of the object (6) . 

42. A process according to Claim 27, wherein a directional 
indicator for the roadway preceding ones own vehicle is 
provided as an image element (4P) . 

43. A process according to Claim 27, wherein the image (B) is 
displayed on a display surface in the dashboard or 
instrument panel (8) or in the field of view of the 
windshield of the vehicle. 

44. A display device (1) for at least one occupant of a vehicle, 
including a segment (2) for display of a perspective image 
(B) of a preceding roadway (F) including an area for at 
least one image element (4A through 4H) , wherein the image 
element (4A through 4H) is changeable in at least one 
characteristic depending upon the preceding roadway (P) , at 
least one operating parameter of the vehicle and/or at least 
one parameter of an object (6) identified in the roadway (P) 

wherein said display device is capable of generating a 
three -dimensionalized representation of the image element 
(4A through 4H) within a three-dimensional image (B) 
representing the vehicle operating environment, and 

wherein said image (B) includes at least one three 
dimensional image element representing an operating 
parameter or providing warning information. 
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45. A display device (1) according to Claim 44, wherein as 
characteristic of the image element (4A through 4H) the 
shape, color, position and/or dimension thereof is 
changeable . 

46. A display device (1) according to Claim 44, wherein a 
roadway (F) , represented three dimensionally, is provided as 
image element (4A) . 

46. A display device (1) according to Claim 44, wherein at least 
one measurement technical means is provided for determining 
the vehicle path (F) , the operating parameter of the vehicle 
and/or the parameter of the object (6) . 

47- A display device (1) according to Claim 44, wherein a 
navigation information system is provided for providing 
information regarding the roadway (F) and/or the object (6) . 

48. A display device (1) according to Claim 44, wherein the 
segment (2) is a multi-color segment. 

49. A display device (1) according to Claim 44, further 
including an acoustic emitter is provided. 

REMARKS 

The specification and claims have been amended to conform 
the original translated specification and claims to U.S. 
requirements, i.e., appropriate section headers are added, 
reference in the specification to the claims have been amended in 
order to eliminate multiple dependent claims and claims 
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improperly depending from multiple dependent claims, and to 
otherwise conform the claims to U.S. practice. Care has been 
taken to ensure that no new matter is added to the text. 

Entry and favorable consideration prior to consideration are 
respectfully requested. 



"EXPRESS MAIL" MAILING LABEL NUMBER: EL568147348US 

DATE OF DEPOSIT: February 21 , 2002 

I HEREBY CERTIFY that the foregoing PRELIMINARY AMENDMENT 
and a stamped receipt post card are being deposited with the 
United States Postal Service "Express Mail Post Office to 
Addressee" service under 37 C.F.R. §1.10 on the date indicated 
and is addressed: ATTN: Box PCT, Commissioner of Patents and 
Trademarks, Washington, D.C. 20231. 

The Commissioner is hereby authorized to charge any 
additional fees which may be required at any time during the 
prosecution of this application without specific authorization, 
or credit any overpayment, to Deposit Account Number 16-0877. 



Respectfully submitted. 



PENDORF & CUTLIFF 
P.O. Box 20445 
Tampa, Florida 33622-0445 
(813) 886-6085 




Date: February 27, 2002 



EXPRESS MAIL CERTIFICATE 




Bonnie . L . Horst 
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VERSION WITH MARKINGS TO SHOW CHANGES MftDE 

The Examiner is requested to accept the marked-up version as 
it is based on the previous version, which when modified as 
below, produces the clean version submitted with the current 
amendment • 

Please amend the claims as follows: 

Please cancel Claims 1-26. 

Please add the following new Claims 27-49: 

--21. A process for displaying a perspective image (B) with 

an image element (4A through 4H) for at least one occupant 
of a vehicle, wherein the image (B) represents the 
perspective of the occupant, said process comprising: 

generating a virtual display representing the operating 
environment of the vehicle, 

displaying within the virtual display the image element 
(4A through 4H) as a three dimensional image, 

changing at least one characteristic of an image 
element (4A through 4H) depending at least one of: 

the roadway ahead (F) , 

an operating parameter of the vehicle, and 

a parameter of an object (6) identified in the area of 

the vehicle preceding roadway (F) , 

wherein said display includes at least one three 

dimensional image element representing an operating 

parameter or providing warning information. 

28. A process according to Claim 27, wherein the change in the 
image element (4A through 4H) is a change in shape, color, 
position and/or dimension. 
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29. A process according to Claim 27, wherein the roadway (F) is 
displayed as an image element (4A) . 

30. A process according to Claim 4, wherein the contour of the 
roadway (F) in the display (B) is continuously conformed to 
the natural course of the stretch of road ahead of the 
vehicle. 

31. A process according to Claim 27, wherein a speedometer or 
tachometer scale (T) is provided as an image element (4B) . 

32. A process according to Claim 31, wherein the speedometer or 
tachometer scale (T) is continuously conformed to the 
contour of the roadway (F) . 

33. A process according to Claim 27, wherein the speed of the 
vehicle is detected as an operating parameter. 

34. A process according to Claim 27, wherein the operating 
parameter of the vehicle is provided as an image element 
(4D) . 

35. A process according to Claim 27, wherein the speed, type 
and/or dimension of the object (6) is determined and 
evaluated as a parameter. 

36. A process according to Claim 27, wherein the object (6) in 
the area of the roadway (F) is classified and evaluated as 
to a type selected from the group consisting of vehicle, 
obstacle, pedestrian and/or traffic sign. 
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37. A process according to Claim 27, wherein a symbol 
representing the object (6) is provided as an image element 
(4E, 4G through 4H) . 

38. A process according to Claim 27, wherein the actual detected 
value of the operating parameter of the vehicle and/or the 
parameter of the object (6) is provided as an image element 
(4D) . 

39. A process according to Claim 27, wherein an acoustic and/or 
an optical signal is emitted upon exceeding and/or falling 
below a threshold value for a characteristic of the roadway 
(F) , the operating parameter of the vehicle, or a parameter 
of the object (6) or the image elements (4A through 4H) . 

40. A process according to Claim 39, wherein the threshold value 
is preset. 

41. A process according to Claim 39, wherein the displayed 
speedometer or tachometer scale (T) is changed in at least 
one characteristic upon exceeding and/or falling below the 
threshold value of the vehicle (F) , the operating parameters 
of the vehicle and/or the parameters of the object (6) . 

42. A process according to Claim 27, wherein a directional 
indicator for the roadway preceding ones own vehicle is 
provided as an image element (4F) . 

43. A process according to Claim 27, wherein the image (B) is 
displayed on a display surface in the dashboard or 
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instrument panel (8) or in the field of view of the 
windshield of the vehicle. 

44. A display device (1) for at least one occupant of a vehicle, 
including a segment (2) for display of a perspective image 
(B) of a preceding roadway (F) including an area for at 
least one image element (4A through 4H) , wherein the image 
element (4A through 4H) is changeable in at least one 
characteristic depending upon the preceding roadway (F) , at 
least one operating parameter of the vehicle and/or at least 
one parameter of an object (6) identified in the roadway (F) 

wherein said display device is capable of generating a 
three -dimensionali zed representation of the image element 
(4A through 4H) within a three-dimensional image (B) 
representing the vehicle operating environment, and 

wherein said image (B) includes at least one three 
dimensional image element representing an operating 
parameter or providing warning information. 

45. A display device (1) according to Claim 44, wherein as 
characteristic of the image element (4A through 4H) the 
shape, color, position and/or dimension thereof is 
changeable . 

46. A display device (1) according to Claim 44, wherein a 
roadway (F) , represented three dimensionally, is provided as 
image element (4A) . 

46. A display device (1) according to Claim 44, wherein at least 
one measurement technical means is provided for determining 
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the vehicle path (F) , the operating parameter of the vehicle 
and/or the parameter of the object (6) . 

47. A display device (1) according to Claim 44, wherein a 
navigation information system is provided for providing 
information regarding the roadway (F) and/or the object (6) . 

48. A display device (1) according to Claim 44, wherein the 
segment (2) is a multi-color segment. 

49. A display device (1) according to Claim 44, further 
including an acoustic emitter is provided. -- 
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METHOD FOR DISPLAYING A PERSPECTIVE IMAGE AND DISPLAY 



DEVICE FOR AT LEAST ONE PASSENGER OF A MOTOR VEHICLE 



BACKGROUND OP THE INVENTION 



Field of the Invention 



[0001] 



The invention concerns a method for displaying a 



perspective image with an image element for at least one 
occupant of a motor vehicle. Beyond this, a display device is 
proposed for at least one occupant of a vehicle with a segment 
for display of a perspective image. 

Description of the Related Art 

[0002] Conventionally, during the operation of a motor 
vehicle, for example a personal automobile, considered in 
particular from the viewpoint of the vehicle operator, a large 
amount of information must be processed - information regarding 
developments in the traffic environment and information from 
instruments in the dashboard. The information in the 

instruments in the dashboard may be displayed in conventional 
analog displays as well as, increasingly, in electronic 
displays • The appearance and mode of the representations in the 
electronic displays is conventionally in the shape of bar 
graphs, static images or numeric displays, as known for example 
from the periodically " auto -mot or- sport " , 9/87, pages 170 
through 174 • 

[0003] The occupant thus must combine very many pieces of 
information from the observation of the present and future 
traffic environment together with the technical information 
provided electronically by the dashboard, for example the speed 
of the own vehicle, in order to be able to safely control the 
vehicle in traffic. In addition, the occupant is forced to 
rapidly react in the case of a dangerous situation, so that 
their ability to glance downwards towards the dashboard and 
therewith the information displayed therein is very limited. 
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Instead, the driver is usually forced to rely on his abilities 
and experience to respond to the dangerous situation. 

[0004] For the rapid overcoming of a particular dangerous 
situation, in particular that of collision or near collision, 
increasingly so-called proximity alarms are known, which warn 
the vehicle operator in the case of a too narrow distance 
between the own vehicle to the preceding vehicle by emitting 
acoustic or optical signals - tones, or vocalized signals or, as 
the case may be, warning lights or bar graphs, so that the 
operator can reduce his speed and thereby increase the spacing. 
A disadvantage with all of these systems is that the occupant 
must separately interpret the environment and the therein 
occurring dangers as well as the therewith associated warning 
signals. This requires time, which is not available, 

particularly in the case of a dangerous situation in which 
response must be made within a few seconds. 

SUMMARY OP THE INVENTION 

[0005] The invention is thus concerned with the task of 
providing a process for displaying traffic information, which 
makes possible in particularly simple means and manner a high 
traffic safety, which is substantially independent from the 
knowledge, experience and ability of the operator. The 
invention is further concerned with the task of providing a 
particularly suitable display device for at least one occupant 
of a vehicle. 

[0006] The first mentioned task is inventively solved by a 
process for displaying a perspective display with an image 
element for at least one occupant of a vehicle, wherein the 
display represents the perspective or view of the occupant, in 
which the image element is changed in at least one 
characteristic depending on the forward travel way (roadway) , 



one operational parameter of the motor vehicle, and/or at least 
one parameter of an object identified in the environment of the 
travel way.xx 

[0007] The invention is based upon the idea, that the high 
mental demands on an occupant of a vehicle, in particular the 
operator or copilot, from the large amount of particularly 
complex information, should be minimized to the extent that by a 
suitable process or, as the case may be, suitable device, the 
occupant is supported for a safe operation of the vehicle. For 
this, the information to be processed by the occupant is brought 
into close proximity with the actual situation, that is, within 
the field of view of the situation as seen by the occupant. 
This makes possible the simple and spontaneous interpretation of 
the traffic situation, in particular the instantaneous traffic 
situation. For this particularly advantageously a perspective 
image is produced and displayed representing the view of the 
occupant, wherein an object lying in the field of view of the 
occupant is modified in this display, such that the image 
element changes its characteristic in adaptation to the current 
vehicle situation. Therewith in particularly simple mode and 
manner, for example by a suitable marking technique in the image 
element, a hazardous situation occurring at the moment is 
enhanced or highlighted in the display, or an important element, 
for example a pedestrian or a preceding vehicle, is highlighted 
within the display. The term roadway is herein in particular 
understood to mean of the forward lying path to be traveled by 
the own vehicle, for example a road or highway. 

[0008] Preferably the size of the image element is changed in 
its shape, color, size, position and/or dimensions. For 
example, in the case of a particularly close distance between 
the own vehicle and an identified object, for example a 
preceding vehicle, obstruction or pedestrian, this object is 



marked as a possible source of danger by a change in color, for 
example from white to red. Preferably in addition the distance 
as well as the position of a representation of an identified 
object is adapted to the continuously changing distancing, so 
that the occupant actually takes notice of this change as in the 
actual view - such as, with moving away from or approaching of 
the vehicle the object gets smaller or, as the case may be, gets 
larger. 

[0009] Preferably the image element is displayed as a three 
dimensional representation. That is, the image element is 
represented with shading, masking, perspective, vertical 
position in the image, as would be observed in the actual field 
of view of the occupant. Thereby, a representation 

substantially corresponding to reality is made possible, so that 
the occupant, in particular the operator of the vehicle can 
grasp the instantaneous situation particularly simply and 
rapidly. In a particularly preferred embodiment a vehicle 
preceding the own vehicle is displayed as an image element. 
Therein the image element representing the roadway or travel way 
shows the perspective representation of the driving situation in 
one plane, preferably from an elevated perspective or the view 
of the vehicle operator. The path of travel is projected quasi 
in perspective representation onto this plane. The plane is 
formed by a display surface in the dashboard or instrument panel 
or by a display surface in the windshield, in which the 
perspective image is projected. 

[00010] The progress along the traveled path is preferably 
continuously updated in the display in accordance with the 
natural course of the stretch of road lying ahead. For this, 
the image element is appropriately changed, for example the 
roadway is represented with the greatest possible reality with 
characterizing bends, curves, changes in elevation and/or road 



crossings* Beyond this, the represented course of the roadway 
can be influenced by ones own driving characteristics, for 
example ones own speed. For this, the preceding roadway 
preferably exhibits multiple segments- Thereby it is possible 
in a particularly simple mode and manner to conform the speed of 
ones own vehicle on the roadway to a desired spacing of the 
vehicle from a preceding object, using a filled- in segment or a 
marking, which could be represented in particular in the form of 
a transverse bar across the roadway display. The length of the 
filled in segment or the distance of the marking of the 
transverse/ spacing bar from the zero point corresponds herein to 
approximately the predetermined length of the desired spacing. 
Alternatively, in place of a desired spacing, it is also 
possible, using ones instantaneous own speed, to display the 
required braking distance. 

[00011] The roadway is beyond this supplementally represented 
using characterizing roadway markings such as for example 
roadside edges and/or centerlines. For this, preferably 
additional image elements are generated - for example, traffic 
signs, depending upon the situation. That is, in particular the 
actual traffic signs are preferably identified and, for example, 
using a control unit, are incorporated into the display, to the 
extent that they are relevant to the preceding roadway. 
Further, as an additional image element, a silhouette of a 
vehicle is projected onto the perspective representation of the 
roadway for a vehicle in the preceding roadway in the path of 
the present vehicle. As additional or alternative image 
elements the physical characteristics, for example the actual 
speed of ones own vehicle or the braking distance or desired 
spacing preceding ones own vehicle, can be generated and 
displayed in the image using measuring technical means. For a 
particularly realistic reproduction of the view of the occupant 
the objects represented by means of the image elements, such as 



1 



for example the traffic signs, are provided with the shading or 
shadows occurring in reality. The number and the type of the 
displayed image elements can be greatly varied. Depending upon 
the embodiment only a single image element, for example, only 
the roadway as such or differentiated by multiple segments, may 
be represented. 



[00012] Beyond this, alternatively or additionally a tachometer 
or speedometer scale is preferably displayed in the plane as an 
image element. Therein the actual speed of ones own vehicle or 
the acceleration thereof is provided in the form of an 
incorporated spotlight or a rolling ball on the tachometer 
scale. Further, this image element is preferably incorporated 
□ in as soon as the vehicle begins to move. As overall image 
element the speedometer or tachometer scale is preferably an 
iji image element blended into or superimposed over the roadway. 
|J Thereby the speedometer or tachometer scale is preferably 
adapted to the profile of the roadway in accordance with the 
ig vehicle operation dynamic characteristics. Preferably, the 
■^l speedometer or tachometer scale follows the contour of the 
m centerline of the roadway. The speedometer or tachometer scale 

Q values are preferably incorporated or blended into the 

ilj . 

intermediate spaces of the interrupted road centerlines. 
Therein, the values are preferably displayed without units, so 
that the tachometer scale is valid both for a display in miles 
per hour as well as in kilometers per hour. 

[00013] As operating parameter of the own vehicle, speed is the 
preferably determined parameter. This is displayed as an image 
element, as already described above, in the form a spotlight 
upon a blended- in speedometer scale. Thereby it is possible to 
easily visualize the situation resulting from ones own speed. 
Beyond this, preferably as parameter for an object lying in the 
path of the vehicle, the speed thereof, the type thereof and/or 
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the dimensions or measurements thereof are determined, in 
particular depending upon the distance from ones own vehicle- 
Depending upon relevancy for the present instantaneous operating 
situation or depending upon requirements, the object is 
preferably displayed as an image element. Preferably 
additionally or alternatively a traffic sign identified as the 
object can be evaluated for relevance, for example, in view of a 
speed limitation, or a preceding vehicle can be evaluated for 
operating safety, and in accordance therewith be generated as an 
image element to be incorporated in the display. 

[00014] In further advantageous embodiments, upon exceeding or 
not attaining a threshold value for a characteristic of the 
vehicle, an operating parameter of the vehicle, a parameter of 
an object and/or the image element, an acoustic and/or optical 
signal can be emitted. For example, a minimum distance from the 
vehicle to an object preceding the vehicle in the roadway can be 
input as intended value or threshold value. Preferably, upon 
going below the threshold, the relevant segment of the roadway 
is represented by a different color, in particular red or 
orange. If the spacing of the vehicle to the preceding object 
is sufficiently large, that is, the threshold is sufficiently 
exceeded, then the corresponding segment of the roadway is 
represented in white. A further example would be the exceeding 
of the acceptable speed of ones own vehicle for the present road 
condition. For this, an acoustic tone is preferably emitted, 
the tachometer scale is appropriately changed in color, that is 
in red color, and/or the speedometer or tachometer scale is 
generated or displayed in such a manner, that it for example no 
longer follows the contour of the course of the roadway. 
Alternatively or additionally, in the case of a braking or speed 
limitation system, the speed of ones own vehicle can 
automatically be appropriately restricted. 



[00015] Beyond this the respective image element of the 
generated object, that is, the preceding vehicle and/or the 
preceding roadway, can be continuously changed with reference to 
the orientation or distance and positioned in the represented 
roadway as the distance between the concerned vehicle and the 
identified object, for example a preceding vehicle, becomes 
smaller or larger. Further, upon dropping below a threshold of 
the generated image element, for example upon falling below the 
minimal acceptable graphic resolution of the image element, 
depending upon the resolution of the display, the concerned 
image element can be deleted or can be represented as a point 
(smallest representable size in the display) . In addition, an 
acoustic signal can be emitted as a warning soxind. 

[00016] Preferably, the threshold value is preset or 
predetermined. For this, for example, the threshold value for 
the threshold distance is modified as a set function depending 
upon the speed of the concerned vehicle. Beyond this, as 
threshold value the respective maximal and/or minimal possible 
graphic size of each image element is predetermined. 

[00017] Preferably, the actual detected value of the operating 
parameter and/or the parameter of the object is displayed as a 
further image element. The display generation or output thereby 
occurs preferably as numeric and/or alphanumeric representation. 
For example, as operating parameter the actual speed of ones own 
vehicle and/or the actual speed of a preceding vehicle is 
numerically incorporated into the display. In addition or 
alternatively the actual distance between the two objects can be 
incorporated numerically in the display. 

[00018] The second mentioned task is inventively solved by a 
display device for at least one occupant of a vehicle with a 
segment for the display of a perspective representation of the 



ahead- lying roadway with an area for an image element, wherein 
the image element is changed in at least one characteristic or 
value depending on the forward travel way (roadway) , one 
operational parameter of the motor vehicle, and/or at least one 
parameter of an object identified in the environment of the 
travel. Preferred as changeable characteristic of the image 
element is the shape, color, position and/or dimension thereof. 

[00019] For a particularly safe guidance of the vehicle, there 
is preferably provided as an image element a three-dimensional 
representation of the roadway. This makes possible, 

particularly from the operator a perspective, representation of 
a substantial area in the operating environment. Therewith a 
virtual display of the vehicle operating situation is produced 
for the operator, which is intuitively simple to grasp. 

[00020] For recognition of the roadway, the operating 
parameters and/or the parameters of the object, at least one 
measurement technical means is provided. For example, as a 
measurement teclinical means for the operating parameter "speed", 
the speedometer of the concerned vehicle can be employed. For 
detecting the roadway, an optical camera is preferably employed. 
In particular, for a night representation of the vehicle 
operating situation, a thermal imaging camera or an infrared 
camera is preferably provided as measurement technical means for 
identification of objects in the roadway. Therewith it is 
ensured that the operator is informed, by means of the display 
device, of objects relevant to the vehicle operating situation 
before ones own detection thereof, wherein these are already 
positioned and represented in the image according to the 
instantaneous operating situation. Beyond this, additional 
vehicle internal and/or external sensors or information systems 
can be provided, for example a vehicle internal navigation 
and/or distance maintaining system, for example employing a 



radar system. As vehicle external system one could mention for 
example a speed governing system or other radio operated system. 
Alternatively or additionally, for determining the roadway 
and/or other parameters of the object, a map or navigation 
information system can be employed. For example, by means of 
the navigation information system, the course of the roadway or 
information regarding the beginning and/or end of a zone is 
automatically generated as an appropriate image element in the 
display. Depending upon the type and model (scope of the 
detailed information) of the navigation information system, the 
need for extensive measurement technical means, and therewith 
the complex data processing, can preferably be reduced. As 
navigation information system there is employed preferably a 
digital recording medium, for example a CD-ROM or an 
alt erna t ing - CD - ROM - pi aye r . 

[00021] For the reliable display of a danger situation, which 
was determined using a control or evaluation unit from the 
values from the measurement technical means, here also for the 
display of various traffic situations the segment is preferably 
a multi-colored segment. Thereby the roadway in particular is 
preferably represented in color. That is, by using appropriate 
color designs for the roadway, in particular a segment thereof, 
it is possible to represent for example the threshold value for 
the distance separation required between the vehicle and an 
object in the roadway depending upon the present speed of the 
vehicle. Alternatively or additionally the necessary braking 
distance can be incorporated as a segment. 

[00022] For signaling a possible danger situation, for example 
in the case of insufficient separation to an object in the 
roadway, a supplemental acoustic and/or optical emitter element 
is provided. Alternatively or additionally the relevant image 
element - the relevant segment of the roadway - can be 
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characterized by an appropriate color - red or orange. 
Preferably a number of image elements is provided corresponding 
to the number of the identified objects. Beyond this, as 
desired, further image elements can be provided in the segment, 
for example one image element for the roadway, for the 
identified object or for at least one operating parameter of 
one's own vehicle. 

[00023] Preferably the display device is employable in the 
vehicle in combination with a distance monitor, a speed governor 
and/or a navigation system. Thereby there is, for example, in a 
special vehicle operating situation in which the conventional 
distance maintaining control system relinquishes the control to 
the vehicle operator, an additional display made possible on the 
display device, which presents the actual driving situation in 
perspective view. By the combination of the display device with 
a navigation system additionally or alternatively recommended 
directions at crossing situations as well as in certain cases 
traffic jam and/or delay warnings can be incorporated in the 
form of image elements. 

[00024] The advantages achieved by the present invention are 
comprised particularly therein, that by the perspective, in 
particular three dimensional representation of the vehicle 
operating environment with the aid of at least one image element 
and the continuous update or conforming thereof to the vehicle 
operating situation in at least one characteristic, the 
occupant, in particular the vehicle operator, can grasp simply 
and rapidly information relevant to operating the vehicle. This 
is in particular facilitated by the representation of the 
vehicle situation in an occupant compatible representation in 
the form of a virtual image. The need for inteirpretation or 
decoding, which has been associated with conventional displays, 
and which lead to an increased burden on the vehicle occupants. 
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is therewith avoided. Therewith the occupant can direct more 
attention to the avoidance or minimization of the danger 
situation. Therewith the operational safety is improved. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[00025] Illustrative embodiments of the invention are shown in 
greater detail on the basis of figures. Therein there is shown: 

Fig. 1 schematic of display device with a segment for an image 
with an image element. 

Pig. 2 

through 4 schematic of the display device according to Fig. 1 
with multiple alternatives for various images with 
multiple image elements, and 

Pig. 5 a perspective image of the display device. 

DETAILED DESCRIPTION OF THE INVENTION 

[00026] The same elements are indicated in the figures with the 
same reference numbers. 

[00027] A display device 1 according to Pig. i includes a 
segment 2 for display of a perspective image B with an image 
element 4A for a preceding roadway F with a direction of travel 
indicated schematically with the arrow P. The respective images 
B in figures 1 through 4 are schematically represented on a 
plane. The three dimensional representation of the image B with 
the image element 4A is shown for example in Fig. 5. Preferably 
a segment 2 is a multicolored segment. By connecting the 
display device 1 with a navigation system the contour of the 
roadway F is appropriately curved, raised or as the case may be 
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interrupted on the basis of data such as curves, bridges, road 
crossing, etc. provided by the navigation system. Therewith the 
roadway P in the display B substantially follows the natural 

course of a roadway to be traveled, in particular the course of 
a road. 

[00028] The roadway F for the respective image B is projected 
onto a plane which is elevated to the perspective or view of an 
occupant, in particular the operator of the vehicle. Beyond 
this as a further image element 4B a speedometer scale T is 
projected into the roadway F. Alternatively the speedometer 
scale T could also be projected as an independent image element 
4B in the display B without the roadway P. Depending upon the 
type and comprehensiveness of data from further systems such as 
navigation systems, information systems or radar systems, the 
speedometer scale T in the display B can follow the natural 
course of the road ahead. 

[00029] As an operating parameter of one's own vehicle, not 
shown, the speed thereof is incorporated in display B in 
pairticular onto the speedometer scale T using a further image 
element 4C. As a further operating parameter of one's own 
vehicle one's own instantaneous position on the roadway is 
continuously indicated. For this the operating parameters are 
detected by means of not shown measurement technical means such 
as for example sensors, optical systems, thermal imaging 
cameras, radar systems and/or information systems. By the 
position of the image element 4C onto the speedometer scale T 
the instantaneous speed of one's own vehicle can be read off as 
being approximately 90 km/h or mph. As image element 4C for 
example a stoplight, a bar or a rolling ball can be employed. 
Alternatively or additionally the numeric numbers of the 
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tachometer scale T which correspond approximately to the 

instantaneous speed of one's own vehicle, can be marked with 
color or changed in color • 

[00030] Depending upon the operating parameter of one's own 
vehicle the image element 4C changes in position • That is upon 
acceleration or braking the image element 4C drifts in the 
tachometer scale T in the direction of the respective value of 
the instantaneous speed. In the case of the numeric display of 
the speed the appropriate numbers of the tachometer scale T 
change in color. For example, only the respective number is 
colored in red, which corresponds to the instantaneous speed of 
one's own vehicle. All other numbers of the tachometer scale T 
are displayed in white. Alternatively, those respective 
numbers, of which the value is smaller than the value of the 
instantaneous speed, can be colored with a first color. Those 
numbers, of which the value is greater than the instantaneous 
value of one's own speed can accordingly be represented in a 
different color. 

[00031] Beyond this, depending upon preferences, the actual 
value of the speed (present speed) , the desired speed of the 
activated cruise control and/or a threshold value of the highest 
speed permissible under the present conditions for the 
immediately preceding roadway F , can be presented alpha 
numerically or numerically as a further image element 4D. 

[00032] In Pig. 2 the display device 1 is shown with the 
segment 2 for an alternative display B with a number of image 
elements 4A through 4C, 4E. 
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[00033] An object 6 identified in the area of the roadway P, 
for example a vehicle driving or standing in the road ahead, is 
shown as a image element 4E. The image element 4E is therein 
preferably represented as a symbol characterizing the object 6 - 
a three-dimensional vehicle silhouette. The image element 4E of 
the object 6 is shown in a shape, dimension and/or position 
corresponding to the present distance from one's own vehicle. 
As the distance of the detected object 6 from one's own vehicle 
increases or decreases, so the associated image element 4E and 
the display B is appropriately adapted in at least one 
characteristic, for example shape, measurement and/ or position. 

[00034] The position of the image element 4E of the object 6 (= 
the preceding vehicle) in display B relative to the image 
element 4C (= spotlight for the speed of one's own vehicle) 
represents the maintenance of the separation required for the 
instantaneous speed. According to the present example in Fig. 2 
the preceding vehicle (image element 4E) is positioned in the 
direction of travel below the spotlight (image element 4C) . 
That means that the safe distance at the present speed of 
approximately 90 km/h or mph is sufficiently large, in order 
that in the case of a emergency braking one's own vehicle can be 
safely stopped in advance of the preceding vehicle. 

[00035] An example of the not maintaining of the safe 
separation is shown in Fig. 3. Here the preceding vehicle 
(image element 4E) is positioned in the direction of travel 
ahead of the image element 4C, which represents the 
instantaneous speed of one's own vehicle. Therewith the 
instantaneous own speed of approximately 90 km/h is too high 
relative to the brake distance required in the case of an 
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emergency braking and accordingly the threshold value to the 
preceding vehicle is not sufficient. This is indicated by an 
appropriate coloration of the image element 4C and/or the 
corresponding numbers "80", "100" and "110" of the speedometer 
scale T which indicate a too high a value for one's present 
speed. By reducing one's own speed to a value below 80 km/h the 
necessary safe distance to the preceding vehicle is 
substantially maintained. By combination of the display device 
1 with a distance maintaining control and/or brake assistant 
system the speed of one's own vehicle can be automatically 
reduced for example upon dropping below the threshold for the 
safe spacing. 

[00036] Alternatively, depending upon the changing operating 
parameters of the vehicle - speed of one's own vehicle - the 
image element 4A for the roadway F can be subdivided into 
multiple segments 1 and II, which are respectively displayed in 
different colors. For signaling a dangerous situation for the 
occupants the segment I is appropriately covered with a signal 
color, for exan^le red or orange. Additionally or alternatively 
an alarm or signal is emitted using a not shown acoustic 
emitter. The segment I represents the brake distance which 
one's own vehicle requires in an emergency situation, depending 
upon the instantaneous own speed, as shown in image element 4C. 
With increasing or decreasing speed of one's own vehicle the 
size of the image element 4E of this position changes - moves 
backwards or as the case may be forwards. 

[00037] In the case, that the display device 1 is connected to 
a navigation system, a road crossing K lying in the area of the 
roadway P is represented in a further image element 4P. The 
term "crossing" K is herein intended to refer to the crossing or 
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junction of at least two roadways P. Depending upon the mode 
and design of the display device 1 and the navigation system it 
is possible by appropriate direction indications R to display 
for the vehicle occupants at the crossing K the future desired 
direction of travel on the roadway P, for example tuiming off to 
the right. 

[00038] As further traffic information a traffic sign is 
displayed in the display B by a supplemental image element 4G, 
which sign has been identified as an object 6 in the area of the 
roadway P by means of a not shown measurement technical means. 
Depending upon type of the identified object 6, the image 
element 46 can be incorporated and displayed in the display B 
for so long, in particular in the course of the roadway P to be 
traveled, until the information associated therewith, for 
example a speed limitation, is no longer valid. The same 
applies for further image elements 4H, which represent for 
example a special zone. Further, in particular by the 
employment of a thermal imaging camera it becomes possible to 
represent with an appropriate element 4E in display B a relevant 
object 6, for example a pedestrian or an un- illuminated 
preceding vehicle, which can be displayed significantly before 
the operator of the vehicle at night can detect the object on 
his own. 

[00039] Alternatively or additionally, for detemining the path 
of travel and/or the parameters of the object 6 a not shown 
mapping or navigation system can be employed. For example using 
a map display the course of the roadway P or information 
regarding the beginning and/or end of localities can be 
automatically provided as appropriate image elements 4A or as 



- 17 - 



the case may be 4H in the display B. As map or navigation system 
one could employ a digital memory such as for example a CD-ROM. 



[00040] A further alternative preferred embodiment of the 
display device 1 is characterized by providing at least one 
parameter of the identified object 6. For this a not shown 
measurement technical means such as for example sensors, 
cameras, radar systems, optical systems and/or information 
systems can be used for detecting the speed, the type and/or the 
dimensions of the object 6 to be identified. For example it is 
possible, as shown in Fig. 1 for one's own vehicle, that in a 
further not shown image element the speed and/or the type of the 
identified object 6 (= preceding vehicle) is provided alpha 
numerically. In the case of a vehicle in particular the license 
plate thereof can be displayed alpha numerically as an image 
element. Preferably the type of the identified object 6 is 
provided in the form of a graphic symbol - here an automobile 
silhouette. Alternatively or additionally the speed of the 
object 6 could be optically incorporated in the speedometer 
scale T as an additionally spotlight. 



[00041] Depending upon the type and design of the above 
described display device 1 this can be connected with a not 
shown system, for example a navigation system or a distance 
maintaining control, in such a manner, that even following 
deactivation of the distance maintaining control on the basis of 
exceeding and/or falling below acceptable threshold values the 
operator or occupants of the vehicle continue to have a good 
overview of the traffic situation by means of the display B in 
segment 2, in particular have an overview of all information 

necessaiy for operating, so that actions can be rapidly and 
safely carried out. 
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[00042] In Fig. 4 a further embodiment is shown for the display 
device 1 with a further alternative display B. Here the 
threshold separation from the preceding object 6 is maintained. 
The roadway P is curved in the direction of travel according to 
arrow P. The maximal permissible speed of one's own vehicle for 
this curve may not exceed 80 km/h or mph. This is however here 
the case - indicated by the image element 4C, which indicates as 
instantaneous speed of one's own vehicle a value of 
approximately 102 km/h or raph. Therewith the permissible speed 
of 80 km/h or mph is substantially exceeded. This fact is 
signaled to the occupants by means of a suitable color marking 
of the image element 4C. Altematively or supplementally the 
numbers of the speedometer scale T, which represent the value 
substantially greater than the maximal permissible speed, are 
characterized by appropriate coloration. A further alternative 
is comprised therein, that the speedometer scale T no longer 
follows the course of the roadway F. Rather the occupants are 
signaled by the deviation of the speedometer scale T from the 
roadway P according to vehicle dynamic limitations, that a 
danger situation would exist in the roadway ahead if the present 
speed is maintained, so that in particular the operator of the 
vehicle can react in rapid and simple manner. 

[00043] In Fig. 5 an example of a perspective image B of a 
display device 1 incoirporated into a dashboard 8 is shown. Here 
the three dimensional representation of the image B is in the 
form of a particularly ergonomic display of a perspective seen 
in the direction of travel R by the occupants of the vehicle in 

an elevated position, as schematically shown in Figs, l through 
4. 
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What is Claimed is: 

!• Process for displaying a perspective image (B) with an image 
element {4A through 4H) for at least one occupant of a 
vehicle, wherein the image (B) represents the view of the 
occupant, wherein depending on the roadway ahead (F) the 
image element (4A through 4H) is changed in at least one 
characteristic by at least one operating parameter of the 
vehicle and/or by or of at least one parameter of an object 

(6) identified in the area of the vehicle preceding roadway 

(F) . 

2. Process according to Claim 1, wherein the size of the image 
element (4A through 4H) is changed in shape, color, position 
and/or dimension. 

3* Process according to Claim 1 or 2, wherein the image element 
(4A through 4H) exhibits a three dimensional representation. 

4. Process according to one of Claims 1 through 3, wherein the 
roadway (F) is displayed as an image element (4A) . 

5. Process according to Claim 4, wherein the course of the 
roadway (F) in the display (B) is continuously conformed or 
adapted to the natural course of the preceding stretch of 
road. 

6. Process according to one of Claims 1 through 5, wherein the 
speedometer or tachometer scale (T) is provided as an image 
element (4B) . 

7. Process according to Claim 6, wherein the speedometer or 
tachometer scale (T) is continuously conformed to the course 
of the roadway (F) . 
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Process according to one of Claims 1 through 7, wherein the 
speed of the vehicle is detected as an operating parameter. 

Process according to one of Claims 1 through 8, wherein the 
operating parameter of the vehicle is provided as an image 
element (4D) . 

Process according to one of Claims 1 through 9, wherein the 
speed, type and/or dimension of the object (6) are 
determined and evaluated as a parameter. 

Process according to one of Claims 1 through 10, wherein in 
the area of the roadway (F) the object (6) is classified and 
evaluated as to type selected from the group consisting of 
vehicle, obstacle, pedestrian and/or traffic sign. 

Process according to one of Claims 1 through 11, wherein a 
symbol representing the object (6) is provided as image 
element (4E, 4G through 4H) . 

Process according to one of Claims 1 through 12, wherein the 
actual detected value of the operating parameter of the 
vehicle and/or the parameter of the object (6) is provided 
as an image element (4D) . 

Process according to one of Claims 1 through 13, wherein an 
acoustic and/or an optical signal is emitted upon exceeding 
and/or falling below a threshold value for a characteristic 
of the roadway (F) , the operating parameter of the vehicle, 
or a parameter of the object (6) or the image elements (4A 
'through 4H) . 
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15. Process according to Claim 14, wherein the threshold value 
is predetermined. 

16. Process according to Claim 14 or 15, wherein the displayed 
speedometer or tachometer scale (T) is changed in at least 
one characteristic upon exceeding and/or falling below the 
threshold value of the vehicle (F) , the operating parameters 
of the vehicle and/ or the parameters of the object (6) . 

17. Process according to one of Claims 1 through 17, wherein a 
directional indicator for the roadway preceding ones own 
vehicle is provided as an image element (4F) . 

□ 18. Process according to one of Claims 1 through 17, wherein the 
image (B) is displayed on a display surface in the dashboard 
or instrument panel (8) or in the field of view of the 
31 windshield of the vehicle . 



I 



19. Display device (1) for at least one occupant of a vehicle, 
[3 with a segment (2) for display of a perspective image (B) of 

g a preceding roadway (P) including an area for an image 

ry element (4A through 4H) , wherein the image element (4A 

through 4H) is changeable in at least one characteristic 
depending upon the preceding roadway (F) , at least one 
operating parameter of the vehicle and/or at least one 
parameter of an object (6) identified in the roadway (F) . 



m 



20. Display device (1) according to Claim 19, wherein as 
characteristic of the image element (4A through 4H) the 
shape, color, position and/or dimension thereof is 
changeable . 
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21. Display device (1) according to Claim 19 or 20, wherein a 
roadway (P) represented three dimensionally is provided as 
image element (4A) . 

22. Display device (1) according to one of Claims 19 through 21, 
wherein at least one measurement technical means is provided 
for determining the vehicle path (F) , the operating 
parameter of the vehicle and/or the parameter of the object 
(6) . 

23. Display device (1) according to one of Claims 19 through 22, 
wherein a navigation information system is provided for 

U determining the iroadway (F) and/or the object (6). 

l|] 24. Display device (1) according to one of Claims 19 through 23, 
'0' wherein as the segment (2) a multi-color segment is 

1»! provided. 

% 25. Display device (1) according to one of Claims 19 through 24, 

ill 

wherein an acoustic emitter is provided. 



26. Use of a display device (1) according to one of Claims 19 
ITJ through 25, in conjunction with a distance maintaining 

system, a speed maintaining system and/or in a navigation 
system. 
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Abstract 



The invention relates to a method for displaying a perspective 
image and to a display device for at least one passenger of a 
motor vehicle. The air of the vehicle is to guarantee by simple 
means a high road safety that is siibstantially independent of the 
knowledge and skills of the driver. To this end, a method for 
displaying a perspective image (B) with one image element (4A to 
4H) for at least one passenger of a motor vehicle is provided, 
said image (B) representing the view of the passenger. According 
to the inventive method, the image element (4A to 4H) is changed 
in at least one size depending on the forward travel way (F) , on 
at least one operational parameter of the motor vehicle and/or on 
at least one parameter of an object (6) identified in the range 
of the travel way (F) . 
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